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Performance Screens for School Improvement: The 
Case of Teacher Tenure Reform in New York City 
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Tenure is intended to protect teachers with demonstrated teaching skills against arbitrary or capricious dismissal. Critics of 
typical tenure processes argue that tenure assessments are superficial and rarely discern whether teachers in fact have the 
requisite teaching skills. A recent reform of the tenure process in New York City provides an unusual opportunity to learn 
about the role of tenure in teachers' career outcomes. We find the reform led to many fewer teachers receiving tenure. 
Those not receiving tenure typically had their probationary periods extended to allow them an opportunity to demonstrate 
teaching effectiveness. These "extended" teachers were much more likely to leave their schools and be replaced by a 
teacher who was judged to be more effective. 
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T eacher tenure has been controversial since the first tenure 
provisions were enacted over a century ago. Proponents 
typically argue that tenure prevents teacher dismissal for 
political purposes or due to capricious decisions by administra¬ 
tors or politicians. Tenure could guard against dismissal of more 
experienced, higher paid teachers during periods of tight budgets 
when school leaders may be more focused on reducing costs 
while meeting class size requirements than they are on student 
learning. Tenure does not require schools or districts to retain 
ineffective teachers but instead provides a due-process mecha¬ 
nism to dismiss tenured teachers for cause. Critics, however, 
argue that the costs of due process do, in practice, lead districts 
to retain ineffective teachers, and as a result, tenure not only 
allows poor teachers to stay in the classroom but also reduces the 
incentive for teachers to be as effective as they could be. They 
argue that the due-process mechanisms for removing teachers 
with tenure are so burdensome that they rarely are pursued. 

With the availability of large-scale student performance mea¬ 
sures linked over time has come clear evidence that teachers vary 
substantially in their effectiveness at improving student test per¬ 
formance and that these differences can have meaningful effects 
on students in both the short run and the long run (Chetty, 
Friedman, & Rockoff, 2014; Rivkin, Hanushek, & Kain, 2005; 
Rockoff, 2004). 1 At least partially as a result, education reforms in 
the United States recently are focusing on improving the quality of 
teaching through human resource policies, such as improved eval¬ 
uation systems and differentiated pay. 2 Given the controversial 


nature of teacher tenure, it is not surprising that interest also has 
increased in changing teacher tenure provisions so that the due 
process is less onerous and so that school leaders have greater con¬ 
trol over their workforce. Yet, the evidence on which to base 
reform decisions is scarce. We know little about what types of ten¬ 
ure provisions improve the quality of teaching and what types do 
not. Similarly, we know little about how long the probationary 
period prior to tenure should be, if there is tenure, in order for 
school systems to accurately assess teachers’ effectiveness so that 
they can make well informed decisions about tenure. 

Part of the reason that we have little evidence on the effects of 
tenure is that until recently, tenure laws have been relatively sta¬ 
ble over time and similar, though not the same, across states. 
New Jersey passed the nation’s first teacher tenure law in 1909. 
Over the next several decades, other states adopted similar laws: 
New York in 1917, California in 1921, and Michigan, 
Pennsylvania, and Wisconsin in 1937. The state statutes use a 
variety of synonyms for tenure', continuing contract or service, 
permanent status, career status, and postprobationary status. 
Regardless of the terminology, these laws have three main com¬ 
ponents: tenure requirements, reasons for dismissal, and a pro¬ 
cess for appeals. The first specifies the length of the probationary 
period after which teachers are eligible for tenure. Employers can 
dismiss a nontenured teacher at any time for any reason so long 


Stanford University, Stanford, CA 

2 University of Virginia, Charlottesville, VA 


Educational Researcher, Vol. 44 No. 4, pp. 199-212 
DOI: 10.3102/0013189X15584773 
© 2015 AERA. http://er.aera.net 


MAY 2015 


199 









as the decision is neither arbitrary or capricious nor discrimina¬ 
tory, but tenured teachers can be dismissed only for the reasons 
provided in the law. The third component details the appeals 
process a dismissed tenured teacher can pursue in an effort to be 
reinstated. Of the 48 states in which public elementary and sec¬ 
ondary teachers are awarded tenure, the minimum probationary 
period exceeds 3 years in 11 states (National Council on Teacher 
Quality, 2012). In most states it is 3 years, although in a few 
states, such as California, teachers typically receive tenure with 
fewer than 3 years of experience. 

Tenure laws in the United States have been the focus of sig¬ 
nificant legislative action in statehouses across the country since 
the beginning of the 21st century. In 2000, Georgia eliminated 
due-process rights for teachers hired after July 1, 2000, but rein¬ 
stated these rights 3 years later. Florida eliminated teacher tenure 
in 2011. That same year, Idaho enacted a law that would have 
eliminated teacher tenure had it not been repealed by voters the 
following year. Voters in South Dakota turned back an effort to 
repeal a 2012 law, thereby allowing a law eliminating tenure after 
July 1, 2016, to take effect. North Carolina’s governor signed a 
bill into law last year that eliminates teacher tenure by 2018. 
Although almost all states currently grant tenure, more than half 
now require meaningful evaluation during the tenure review 
process. As an example, in 2009, only four states used student 
test performance as a criterion for tenure; by 2012, 20 states did 
and 23 states require multiple categories for teachers in their 
evaluation, not just satisfactory and unsatisfactory (National 
Council on Teacher Quality, 2012). 

The debates around teacher tenure have taken on a new inten¬ 
sity as the locus for those debates has shifted to the courthouse. 
The 2014 court ruling in Vergara v. California found elements of 
California’s tenure provisions to be unconstitutional, setting 
California on a course to eliminate teacher tenure unless the 
state’s appeal is successful ( Vergara v. California , 2014). Similar 
cases are being brought in other states, but it remains unknown 
whether strategies to eliminate tenure will ultimately be success¬ 
ful and whether revisions to tenure policies can achieve the key 
goals of reformers. 

A recent reform by the New York City Department of 
Education (NYCDOE) provides an unusual opportunity to 
learn about the role of tenure in teachers’ career outcomes, 
including both strategic retention on the district side and choice- 
based retention stemming from teachers’ decisions. Although 
not nearly as provocative as the elimination of tenure, modest 
reforms to the tenure process may produce many of the out¬ 
comes raised by plaintiffs in Vergara and other court cases as 
reasons for elimination of tenure. Knowing more about the 
effects of using better information in the tenure process and 
about the effects of longer probationary periods on the effective¬ 
ness of the teacher workforce could substantially enlighten the 
discussion over tenure. In what follows, we start by describing 
the New York City reform. We then use data from NYCDOE 
and the New York State Education Department (NYSED) to 
provide initial evidence on the magnitude of responses to the 
reform, concluding with a discussion of the results. We find that 
the NYCDOE tenure reforms extended the probationary peri¬ 
ods of teachers judged to be less effective and that these 
“extended” teachers were substantially more likely than other 
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teachers to leave their schools. Their likely replacements were 
typically more effective as judged by their principals and as mea¬ 
sured by value added. These changes disproportionately bene¬ 
fited schools with larger percentages of Black students. 

The Teacher Tenure Process in New York City 

Tenure marks a new phase in a teachers career and a new 
commitment by our schools to those who receive it. Unfortunately, 
over the years tenure has become an expectation more than an 
honor. While we have made progress, we still are not doing enough 
to set a high bar for all teachers, recognize excellent teachers, or 
withhold tenure from all of those who have not earned it. And a 
loose tenure system isn’t good for anyone—it hurts students, it 
disrespects successful teachers, and it leaves those who are not up 
to the difficult job to struggle. 

—New York City Schools’ Chancellor Klein, 
Letter to Teachers, February 10, 2010 

The criterion for tenure in New York City is that a teacher possesses 
“significant professional skill and a meaningful, positive impact on 
student learning” (NYCDOE, 2009b, FAQ, p. 1). This criterion is 
not new. However, prior to academic year (AY) 2009-2010, the 
tenure process in New York City was similar to that in many other 
large urban districts. The receipt of tenure had become an expecta¬ 
tion for nearly all teachers and frequently was based on little evi¬ 
dence of accomplishment. In 2007-2008 and 2008-2009, well 
into the period of accountability reforms, 94% of all eligible teach¬ 
ers who stood for tenure decision were approved for tenure. 3 

Beginning in 2009—2010, New York City changed the tenure 
review process, infusing more information and increasing the 
responsibility and accountability of principals to ensure that 
teachers met challenging performance standards. Tenure decisions 
in 2009-2010 were informed by sources of information that had 
been available previously: classroom observations; evaluations of 
teacher work products, including lesson plans; and the annual rat¬ 
ing sheet that principals completed giving teachers a satisfactory ; 
doubtful, or unsatisfactory rating. In addition, tenure decisions in 
2009-2010 included new student learning measures from the 
Teacher Data Reports (which included teacher value added), in- 
class assessments aligned with the New York State standards, and 
other evidence of student progress (NYCDOE, 2009a). 

As in previous years, principals sent recommendations to the 
superintendent about whether a teacher should be denied tenure, 
have their probationary period extended, or be granted tenure, but 
starting in 2009-2010, principals had to provide a rationale for 
this decision if the evidence available at the district level suggested 
either a strong case to approve or deny tenure and this information 
ran counter to the principal’s recommendation. The district pro¬ 
vided principals with tenure guidance for teachers for whom there 
was evidence that performance was particularly strong or weak. 
For a teacher whose value-added results had been in the lowest 
50% over the past 2 years (with a 95% confidence interval), who 
had previously received an unsatisfactory annual rating, or whose 
tenure decision had previously been extended, the principal 
received guidance from the district that the teacher should be con¬ 
sidered to have “tenure in doubt.” A principal recommendation to 
extend or approve tenure for these teachers required a supporting 
rationale for the superintendent to consider in his or her review. 



The principal received guidance of “tenure likely” for a teacher 
whose value-added results had been in the highest 50% over the 
past 2 years (with a 95% confidence interval). Principals recom¬ 
mending denying tenure or extending the probationary period for 
these teachers similarly needed to provide supporting evidence to 
the superintendent (NYCDOE, 2009a). 

The process introduced in 2009-2010 remained in place in 
2010-2011 with some notable changes (NYCDOE, 2010). New 
in 2010-2011, principals were asked to evaluate all teachers up 
for a tenure decision based a 4-point effectiveness rating scale 
(highly effective, effective, developing, and ineffective) as described 
in the district-developed Effectiveness Framework. 4 As in the 
prior year, the evidence for these ratings came from measures of 
the teacher’s impact on student learning, such as value-added 
measures from the Teacher Data Reports, student work products, 
and tests aligned to the New York State standards. Principals also 
could use evidence from measures of instructional practice com¬ 
ing from their own classroom observations, teacher work prod¬ 
ucts, and the annual rating sheet that principals complete for each 
teacher. 5 In addition to these sources of information, which were 
available in the prior year as well, principals in 2010-2011 gained 
information about professional contributions from surveys of 
students and parents, from measures of attendance, from col¬ 
league feedback, and from work products related to the 
Comprehensive Educational Plan for each school. In contrast to 
2009-2010, principals in 2010-2011 no longer received guid¬ 
ance regarding “tenure likely” or “tenure in doubt” from the dis¬ 
trict but rather were given flags indicating a “low-value-add” 
teacher as an “area of concern” and a “high-value-add” teacher as 
a “notable performance.” Low and high value-added scores were 
defined as in the previous year. Other problematic teacher behav¬ 
iors flagged as areas of concern included low attendance (defined 
as exceeding 20 days in the previous two fiscal years), an unsatis¬ 
factory or doubful rating on a prior annual review sheet, having 
been previously extended, having been previously excessed, or 
currently being in the Absent Teacher Reserve pool. 6 

The tenure review process for 2011-2012 was very similar to 
that in 2010-2011 but with two important changes. As before, 
teachers were evaluated on their impact on student learning, 
instructional practice, and professional contributions. Principals 
were provided guidance as to the expected (though not required) 
alignment between the effectiveness ratings they determined 
using the Effectiveness Framework and their tenure recommen¬ 
dations: highly effective and effective ratings were evidence in favor 
of granting tenure; a developing rating, evidence for an extension; 
and an ineffective rating, evidence for denying tenure. Additionally, 
responsibility for producing teacher value-added estimates shifted 
from the district to the NYSED beginning with 2010-2011, and 
no measures were available for principals to incorporate them 
into their 2011-2012 tenure decisions (NYCDOE, 2011). 

The state-provided value-added estimates did inform princi¬ 
pals’ 2012-2013 recommendations. Teachers received a growth 
score (0-20) that corresponded to a HEDI (highly effective, effec¬ 
tive, developing, and ineffective) rating. No explicit guidance was 
provided to principals as to how to incorporate these growth 
ratings into their tenure recommendations. They were told only 
that these ratings were a source of evidence for a teacher’s impact 
on student learning. 


Screening Employees to Improve Quality 

How might we expect principals and teachers to respond to the 
New York City tenure policy changes? Consider a principal who 
aims to improve the quality of instruction in his or her school in 
the short run. Principals are likely to have this goal for numerous 
reasons, including the high rate of principal mobility in urban 
school districts (Beteille, Kalogrides, & Loeb, 2012), the sub¬ 
stantial accountability pressure on principals, and the principal 
training and selection mechanisms in place in New York City. 7 
To be more specific, we assume that quality of instruction {Y s ) in 
school s in time t is a function of the underlying quality of the 
teachers {Tf, of some form of investment (IJ that teachers 
make to improve their performance and the performance of 
their peers, and of other aspects of the school (OJ. 

Y s t = Qifst’ft’Ost)- 

A principal will choose to deny, extend, or grant tenure to 
teachers in order to maximize school quality. However, a priori, it 
is not clear how the choice of tenure for a given teacher will affect 
who teaches in the school or how it will affect teachers’ invest¬ 
ment in their work. These dynamics depend upon how teachers 
respond to the decisions both about themselves and about other 
teachers in the school. If teachers do not change their choices in 
response to tenure decisions, then the principal’s decision is 
straightforward: Deny teachers whom they want to leave the 
school and extend all other teachers. There would be no reason to 
recommend tenure for any teacher since this decision limits the 
principal’s future actions and provides no benefits in the present. 

However, there are reasons to believe that teachers do care 
about tenure. As an example, Brunner and Imazeki (2010) find 
that districts with longer probationary periods compensate teach¬ 
ers more, other things equal, indicating that teachers value shorter 
probationary periods and are willing to accept somewhat reduced 
compensation in return. This finding is consistent with evidence 
from other occupations that jobs with greater risk—greater phys¬ 
ical risk, greater risk of unemployment, or less predictable 
salaries—have to pay more in order to attract the same-quality 
workers (Feinberg, 1981). These results lead us to assume that, in 
deciding whether or not to stay in a job, teachers value job stabil¬ 
ity and thus care about whether or not they have tenure. 

Teachers are also likely to value being recognized for strong 
performance as well as simply gaining utility from strong perfor¬ 
mance itself (Kalleberg, 1977). Evaluation systems that differen¬ 
tiate among employees are likely to increase the satisfaction of 
teachers who perform well and may increase their willingness to 
stay in the school. For those on the borderline of a positive review, 
this evaluation may also increase their interest in investing in 
their own improvement and the improvement of their peers. The 
same differentiation is likely to have negative consequences for 
the satisfaction of teachers who perform worse on the evaluations, 
perhaps decreasing their interest in staying and investing. 

Finally, teachers care about the pecuniary and nonpecuniary 
job attributes that informed their rationale for becoming a 
teacher (Flyer & Rosen, 1997). Some of these characteristics—in 
particular, the climate of the school, such as the attitudes of 
teachers and their willingness to support other teachers in the 
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school—may change as a result of the implementation of tenure 
reform in each school, thereby serving as a mediator for the 
reform’s impact on instructional quality. For some teachers, the 
benefits of being a teacher far outweigh those of alternative occu¬ 
pations, whereas for others, the choice is less clear. 

Learning to become an effective teacher is complicated and 
dependent not only on the teacher’s ability and motivation but 
also on prior preparation and the opportunities, culture, and 
support he or she receives in the school. As a result, identifying 
teachers as approved, extended, or denied for tenure inevitably 
means that each category contains a heterogeneous grouping of 
teachers who find themselves in that group for a variety of rea¬ 
sons. Increasing the rigor of performance screens is intended to 
reduce this heterogeneity so that teachers approved for tenure are 
effective. However, like human resources management in any 
profession, this is not an exact science, implying that misidenti- 
fication occurs and that some teachers not approved for tenure 
could have been approved if the measures were more nuanced or 
their schools more conducive to their growth. 

In shaping the quality of teaching in their schools, principals’ 
tenure recommendations are likely informed by their percep¬ 
tions of how teachers will respond to tenure outcomes and on 
the effect of teacher turnover on student achievement (Ronfeldt, 
Loeb, & Wyckoff, 2013). Are teachers more likely to improve or 
leave their school in response to being extended? Given the dra¬ 
matic effect of NYCDOE tenure reform on the percentage of 
teachers extended, in this article we focus on the retention deci¬ 
sions of extended teachers. However, the reform could well 
influence other teacher decisions. For example, does the reform 
affect whether individuals are attracted to teaching in New York 
or how much investment teachers make in their teaching effec¬ 
tiveness? Does it influence the retention decisions of teachers 
who are approved for tenure? Conceptually, tenure reform could 
influence each of these directly or through changes in the school 
learning environment. These decisions are potentially impor¬ 
tant, but in this article we focus solely on the effects of tenure 
reform on teacher retention due to data limitations. 

Consider those teachers who would have received tenure pre¬ 
reform but are extended postreform. These teachers now receive 
negative signals about their teaching with an increased potential 
of being denied tenure. Each of these increases their likelihood 
of leaving teaching, particularly at their current school. However, 
for some teachers who are extended, the appeal of teaching will 
be high enough to lead them to choose to stay in teaching. For 
this subgroup, an increase in investment may increase their 
probability of future recognition and receipt of tenure. This 
group may increase investment as a result of reforms if they 
assess that this increase will likely lead to tenure in the future. 
Understanding the potential effects of tenure reform on teacher 
behavior, principals will be more likely to extend teachers who 
are not performing well if they believe they can hire more effec¬ 
tive teachers. Because school principals play a central role in the 
process and because the teacher workforce differs across schools, 
we might expect the changes to differ across schools. In keeping 
with these potential effects, we address the following three 
research question in this article: 


1. Tenure decisions: How did tenure rates change following 
reform? 

2. Workforce composition: Of teachers who become eligi¬ 
ble for tenure, how did the composition of those continu¬ 
ing to teach in New York City change following reform? 

3. School differences: How have schools varied in their tenure 
decisions and the subsequent behaviors of their teachers? 

Data 

In order to assess the effects of NYCDOE tenure reforms, we must 
accurately identify teachers eligible for tenure as well as other teach¬ 
ers potentially affected by the changes. The Tenure Notification 
System (TNS) tracked the tenure review process for all probation¬ 
ary teachers in New York City public schools between 2007-2008 
and 2012-2013. Each school year, the district made tenure deci¬ 
sions for teachers whose probationary period was scheduled to con¬ 
clude between November 1st of the current school year and 
October 31st of the following school year. The probationary peri¬ 
ods for the 2009-2010 cohort, for example, concluded between 
November 1, 2009, and October 31, 2010. The TNS provided 
principals with a list of teachers at their school eligible for tenure as 
well as all official guidance concerning each teacher’s job perfor¬ 
mance prior to the current year (e.g., prior unsatisfactory annual 
performance ratings, low attendance, value-added classification, 
etc.). Principals enter their preliminary and final ratings and rec¬ 
ommendations into the TNS, and district superintendents make 
and record final tenure decisions in the system. 

We assembled additional information on all teachers, not just 
those in the TNS, from a variety of sources. NYCDOE provides 
basic teacher demographic characteristics, the value-added cal¬ 
culations for 2008-2009 and 2009-2010, the state’s value- 
added calculations for 2011-2012, and annual performance 
ratings used in the tenure review process. We identify teachers’ 
pathways into the teaching profession from state certification 
records and rosters for the New York City Teaching Fellows pro¬ 
gram and Teach for America corps members in the New York 
City region. State certification files provide scores on certifica¬ 
tion exams. From the College Board, we obtain teachers’ SAT 
scores for those teachers who attended a New York public school 
from 1980 to 2008 or a New York private school from 1980 to 
2001. Characteristics of the schools in which teachers teach 
(e.g., race/ethnicity, free/reduced-price lunch eligibility, ade¬ 
quate yearly progress status, etc.) come from the annual state- 
level School Report Cards database and Institutional Master 
Files and the federal Common Core of Data. 

Finally, leveraging data from the NYCDOE Teacher Data 
Initiative, we observe characteristics of the students taught by 
specific teachers of Grades 4 through 8 mathematics and English 
language arts (ELA), including demographic and achievement 
information. We use these data to estimate our own yearly value- 
added measures of teacher effectiveness using the residuals-based 
approach described in the technical appendix that controls for 
individual student, classroom, and school characteristics. 8 
Currently, 2010-2011 is the final year for which we can calcu¬ 
late these estimates. 
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Just over three quarters of the teachers in our postreform 
sample are female, approximately 18% are Black, and 17% are 
Hispanic. They have average math and verbal SAT scores of 
approximately 500 points each. Approximately half of the teach¬ 
ers entered teaching through traditional teacher preparation pro¬ 
grams that recommended certification, and 22 percent came 
through the Teaching Fellows program, the largest early-entry 
route serving New York City. These teachers work at schools 
where 44% of students are Hispanic students and 31% are 
Black, with 67% eligible for subsidized lunch (see Table A1 in 
the appendix). 

Recall that principals complete an Annual Rating Sheet for 
each teacher. Just 2.3% of teachers in our sample received an 
unsatisfactory rating, and 0.1% of teachers received a doubtful 
rating, with the remaining 97.6% receiving a satisfactory rating. 
On the 4-point effectiveness rating scale assigned by their prin¬ 
cipals, most teachers received either a developing (29%) or an 
effective (41%) rating, whereas 17% received highly effective and 
2% received ineffective ratings. Principals provided no effective¬ 
ness rating for 11% of teachers. Eight percent of teachers had 
what the district classified as low attendance (more than 20 
absences over prior 2 years), and 12% had low value added. 

Results 

Tenure Decisions 

As described in Figure 1, 94% of teachers were approved for 
tenure during AY 2007-2008 and 2008-2009, the 2 years prior 
to the introduction of the policy. The approval rate dropped to 
89% in the first year of the policy (2009-2010) and averaged 
56% in the 3 subsequent years. 9 Virtually all of the decrease in 
the tenure approval rate resulted in an increase in the percentage 
of teachers whose probationary periods were extended, which 
averaged less than 4% prior to the policy but 41 % in 2010-2011 
through 2012-2013. The percentage of teachers denied tenure 
increased marginally following the introduction of the new ten¬ 
ure review process, from an average of 2% prepolicy to 3% 
postpolicy. 

Principals have played an important role in the determination 
of tenure decisions. Principal effectiveness ratings of teachers 
using the Effectiveness Framework are highly predictive of ten¬ 
ure outcomes under the new policy. Ninety-four percent of 
teachers rated highly effective and 83% of those rated effective 
were approved for tenure. In contrast, fewer than 2% of those 
rated developing and fewer than 1% of those rated ineffective 
were approved. The vast majority (97%) of teachers rated devel¬ 
oping were extended, whereas the vast majority (81%) of those 
rated ineffective were denied tenure. Given that almost all teach¬ 
ers were approved for tenure prior to the reform, many teachers 
who would have been approved prior to the reform received a 
different outcome under the new system. 

Tenure decisions also correspond with other teacher perfor¬ 
mance measures. For teachers in tested grades and subjects, 
value-added estimates track tenure decisions. Teachers denied 
tenure have math value-added estimates that are a full standard 
deviation lower in teacher effectiveness than those approved for 
tenure. On average, extended teachers are 13% of a standard 



2007-08 2008-09 2009-10 2010-11 2011-12 2012-13 

> Approve M Deny — 'J? — Extend 

FIGURE 1. Percentage of teacher tenure cases by tenure outcome 
2007-2008 to 2012-2013 

deviation less effective in student achievement than the average 
teacher and 38% of a standard deviation less effective than those 
who are approved. Value-added differences in ELA are smaller 
but demonstrate the same pattern. Similarly, extended teachers 
are far more likely to have had prior unsatisfactory or doubtful 
annual performance ratings and to have had low attendance than 
are teachers approved for tenure (see Table A3 in the appendix). 

Overall, the reforms dramatically reduced the percentage of 
teachers who received tenure, but because most teachers who 
became eligible for tenure were extended and not dismissed, it is 
unclear a priori whether the reform meaningfully altered the 
workforce. 

Workforce Composition 

Changes in the tenure process can affect the quality of teaching 
by denying tenure to less effective teachers. As discussed, denied 
teachers had lower value added in both math and ELA than 
teachers who were extended or approved. However, even under 
the new policies, few teachers are dismissed. Larger changes in 
the workforce instead may come from changes in voluntary 
turnover, particularly of teachers who are extended. 

Extended teachers may voluntarily exit from New York City 
schools, creating vacancies that can be filled by more effective 
teachers. We find some evidence of this phenomenon. Extended 
teachers were more likely to transfer to other New York City 
schools and exit teaching in New York City public schools alto¬ 
gether in the year following their decision than teachers who 
were approved for tenure. Ninety percent of approved teachers 
return to their schools, whereas only 75% of extended teachers 
did so. 

Being extended appears to meaningfully increase the likeli¬ 
hood of transfers and exits, as extended teachers are more likely 
to leave even after controlling for teacher and school characteris¬ 
tics. Table 1 shows regressions with controls for the final princi¬ 
pal effectiveness rating of the teachers and includes school fixed 
effects, allowing us to examine the effect of being extended on 
teacher transfer and exit behavior for teachers in the same schools 
with equivalent principal ratings. The probability of transferring 
increases by 9 percentage points if the teacher had been extended 
rather than approved. This represents a 50% increase in the 
probability of transferring following a tenure decision. Similarly, 


MAY 2015 


203 










Table 1 

Determinants of Teacher Disposition in Year Following Tenure Decision, 2010-2011 and 2011-2012 


Variable 

(D 

(2) 

(3) 

(4) 

(5) 

(6) 

Transfer 

Transfer 

Transfer 

Exit 

Exit 

Exit 

Extend 

0.145** 

0.124** 

0.087** 

0.057** 

0.055** 

0.040** 


(15.21) 

(13.04) 

(6.06) 

(9.38) 

(9.07) 

(4.32) 

Student attributes 







Mean math score 

-0.024 



0.016 




(-0.68) 



(0.68) 



Mean English language arts score 

-0.024 



-0.019 




(-0.64) 



(-0.82) 



Black (%) 

0.113* 



0.042* 




(4.24) 



(2.46) 



Hispanic (%) 

0.066f 



0.075** 




(2.35) 



(4.21) 



Free lunch (%) 

-0.099** 



-0.085** 




(-3.12) 



(-4.23) 



Reduced lunch (%) 

-0.307* 



-0.187* 




(-2.33) 



(-2.23) 



Principal effectiveness ratings 







Ineffective 



0.285* 



0.110* 




(4.24) 



(2.54) 

Developing 



0.071** 



0.026* 




(3.58) 



(2.02) 

Effective 



0.030* 



0.007 




(2.13) 



(0.74) 

Missing 



0.045* 



0.013 




(2.45) 



(1.11) 

Constant 

0.142** 

0.135** 

0.111** 

0.064** 

0.037** 

0.031** 


(4.88) 

(24.56) 

(9.60) 

(3.48) 

(10.52) 

(4.22) 

School fixed effect 


X 

X 


X 

X 

Observations 

6,351 

8,855 

8,855 

6,351 

8,855 

8,855 


Note. T statistics in parentheses. 
tp< .10. *p< .05. **p< .01. 


extended teachers exit New York City public schools at a rate 
that is 4 percentage points higher than approved teachers, hold¬ 
ing other factors constant. This represents a 66% increase in the 
probability of exiting. These results provide suggestive evidence 
that the new tenure process is having an effect on the composi¬ 
tion of the teaching workforce even without substantially 
increasing the percentage of teachers directly denied tenure. 
However, we cannot rule out that other factors correlated with a 
teacher’s extended status may account for the increases in trans¬ 
fer and exit rates. 

Among extended teachers, those who remain in the same 
school have somewhat different measured attributes than those 
who transfer or exit the system. Teachers with higher academic 
qualifications, such as teacher certification exam scores, are less 
likely to stay in the same school than to exit. Extended teachers 
entering through alternative routes, such as the New York City 
Teaching Fellows program or Teach for America, are less likely 
to remain in the same school than teachers entering through 
college-recommended programs. In contrast, the average 
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value-added estimates of extended teachers who remain in the 
same school are higher than those of extended teachers who do 
not, but the sample sizes are smaller for these measures and the 
differences are not statistically significant at traditional levels (see 
Table A4 in the appendix). 

The voluntary attrition of these less effective teachers would 
benefit students only if they are replaced by relatively more effec¬ 
tive teachers. We explore this question by comparing the effec¬ 
tiveness of teachers who were extended and left schools in 
2010-2011 or 2011-2012 with teachers hired at these schools. 10 
Unfortunately, teacher effectiveness measures for teachers hired 
at these schools in 2011-2012 and 2012-2013 (actual replace¬ 
ments) are unavailable. Rather, we employ the effectiveness of 
teachers hired at these schools in 2008-2009 and 2009-2010. 11 
As might be inferred from the previous analysis, the extended 
leavers will be less effective than the average of teachers hired in 
their cohorts (extended teachers are less effective than those 
approved, and extended leavers are less effective than extended 
teachers who remain). This analysis differs somewhat in that we 





Table 2 

Mean School Difference in Teacher Effectiveness Measures Between Proxy Replacement and Extended 
Leavers in Schools With Extended Leavers, 2010-2011 and 2011-2012 


Extended Leaver Status 

Principal Final Effectiveness Rating (%) 

Value Added 

Highly 

Effective 

Effective 

Developing 

Ineffective 

English 

Language Arts 

Math 

All extended leavers 

14.34*** 

30.7*** 

-36.45*** 

1.37* 

.197** 

.119 

Extended transfers 

11.97*** 

30.16*** 

-34.53*** 

1.14 

.127 

.181* 

Extended exiters 

16.15*** 

27.55*** 

-33.24*** 

1.72 

.298* 

.037 


Note. Proxy replacement teachers are all teachers hired at the school in 2009 and 2010. Only schools with an extended leaving teacher in 2011 or 2012 included in all 
comparisons. Positive values indicate on average within-schools average value for replacement pool exceeds that for the extended leavers. 

*p< .05. **p< .01. ***p < .001 (comparing extended leavers to proxy replacements). 


include all hires, including within district transfers, new hires 
with tenure, and those who exited prior to a tenure decision. 
Also our model compares extended leavers to the attributes of 
new hires solely in their school, which could make a difference as 
extended leavers tend to be concentrated in a more limited group 
of schools. Finally, we develop a second replacement group com¬ 
posed of teachers hired from 2006-2007 through 2009-2010. 

It is certainly conceivable that the tenure reforms might 
change the labor market for new teachers and that actual replace¬ 
ments might be less effective than those hired prior to reforms as 
they may be concerned that they, too, might be more likely to be 
extended. However, the reverse is also true, especially in schools 
with extended teachers, where effective teachers might find the 
improvement in the effectiveness of peers an attraction. As a 
result, the use of proxy replacements should be viewed as an 
approximation. For each school with an extended leaver, we 
compare the average effectiveness of extended leavers with that 
of their proxy replacements and then average these within school 
differences across all such schools. In this way we examine the 
difference in teacher effectiveness between extended leavers and 
proxy replacements in the typical school. 

As shown in Table 2, there are substantial differences in the 
effectiveness of extended leavers and their proxy replacements. 
For example, there are 45 percentage points fewer teachers rated 
as highly effective or effective among all extended leavers than 
their proxy replacements (14 percentage points for highly effec¬ 
tive and 31 percentage points for effective). Estimated value 
added in ELA is 20% of a standard deviation higher among the 
proxy replacements than among the extended leavers. 12 Although 
proxy replacement teachers are estimated to outperform extended 
leavers in math value added, this difference is not statistically 
significant at traditional significance levels, due primarily to rela¬ 
tively few observations (n= 158). 

From a principal’s perspective, these are large effects relative 
to almost any other intervention he or she might contemplate. 
For example, many principals rightly privilege experience when 
hiring teachers, as the value added of a teacher with 6 years of 
experience is estimated to be up to 15% of a standard deviation 
higher than that of a novice teacher (Atteberry, Loeb, & Wyckoff, 
2013). Extending the probationary period of teachers with 
insufficient skills to be approved for tenure and thereby nudging 



0 .2 .4 .6 .8 1 

Proportion Approved 


FIGURE 2. Distribution of school proportion of tenure cases 
approved2009-2010 through 2012-2013 
Note. Includes only schools with at least four tenure decisions 
over the period (81% of all schools). 

some teachers to leave the school who are then replaced with a 
new teacher has an effect on teacher effectiveness about the same 
as the gains of hiring a teacher with 6 years of experience rather 
than a novice. 

School Differences 

Although implementation of the policy may have varied across 
schools, most schools experienced a substantial change in the 
percentage of teachers who were approved for tenure under the 
new policy. More than 70% of schools granted tenure to fewer 
than 80% of their teachers following the introduction of the 
policy, as shown in Figure 2. Although a cluster of schools 
approved 100% of eligible teachers, most schools approved far 
less, with another large cluster of schools with between 50% and 
70% approval. 

The variation in approval rates seen in Figure 2 corresponds 
to some school characteristics, particularly, average student attri¬ 
butes, as shown in Table 3. On average, teachers approved for 
tenure work in schools in which the percentage of White 
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Table 3 

Attributes of the Students in Teacher's School by Tenure Decision and Principal 
Effectiveness Rating, 2010-2011 and 2011-2012 


Variable 

White 

(%) 

Hispanic 

(%) 

Black 

(%) 

Home 
Language 
English (%) 

Free 

Lunch(%) 

Reduced 
Lunch (%) 

Math 

Achievement 
(z score) 

ELA 

Achievement 
(z score) 

Tenure decision 3 

Approve 

13.8 

44.4 

27.4 

56.6 

72.3 

4.4 

.081 

.086 

Extend 

8.9 

44.6 

35.1 

60.3 

77.3 

4.1 

-.066 

-.042 

Deny 

7.1 

43.5 

39.6 

63.3 

77.8 

4.2 

-.152 

-.093 

Principal effectiveness rating b 

Highly effective 

16.4 

42.8 

24.1 

56.5 

69.2 

4.8 

.184 

.181 

Effective 

12.1 

45.3 

29.9 

57.2 

74.6 

4.2 

.007 

.019 

Developing 

8.4 

45.0 

35.3 

60.8 

78.1 

4.1 

-.068 

-.046 

Ineffective 

7.2 

42.4 

39.9 

62.7 

77.7 

4.6 

-.161 

-.102 

No rating 

12.3 

42.7 

31.0 

57.4 

71.3 

4.1 

.055 

.073 

Total 

11.7 

44.5 

30.8 

58.3 

74.4 

4.2 

.015 

.029 


Note. ELA = English language arts. 

Extended teachers work in schools with different student attributes than approved teachers [p value less than .01 for all attributes except the percentage of Hispanic 
students). Teachers denied tenure work in schools with different attributes than teachers who are extended with respect to the percentage of students who are Black, the 
percentage whose home language is not English, and mean student math scores (p value less than .05). Differences in other student attributes are not significantly different 
from zero. 

Teachers rated ineffective work in schools with different student attributes than teachers rated effective or highly effective (p value less than .01 for all attributes except 
the percentage of Hispanic students and the percentage eligible for reduced-price lunch). Teachers rated developing work in schools with different student attributes than 
teachers rated effective or highly effective (p value less than .01 for all attributes except the percentage of Hispanic students). 


students is more than 50% greater than schools where teachers’ 
probation is extended. Black students experience the reverse. In 
schools where teachers are approved for tenure, Black students 
compose 27% of all students, but they compose 35% of students 
in schools where teachers’ probation is extended. The achieve¬ 
ment of students in schools where teachers receive tenure is 15% 
of a standard deviation better in math and 13% of a standard 
deviation better in ELA than the average achievement in schools 
where teachers are extended. 

Given the strong link between principal effectiveness ratings 
and tenure decisions, it is not surprising that the pattern of dif¬ 
ferences in school attributes across principal effectiveness ratings 
mirror the differences across tenure outcomes, as shown in Table 
3. For example, the average highly effective teacher works in 
schools where the percentage of White students is twice as large 
as it is for the average ineffective teacher. The average ineffective 
teacher is located in a school with 65% more Black students than 
his or her average highly effective colleague. As is also shown in 
Table 3, the average ineffective teacher is located in a school 
where the ELA performance of students is more than a quarter 
of standard deviation lower and more than 30% of a standard 
deviation lower in math than that of the average highly effective 
teacher. This suggests that replacing ineffective and developing 
teachers with a teacher whose performance is closer to the aver¬ 
age would disproportionately improve the quality of teaching in 
schools with higher percentages of Black students. 

To examine the types of schools most affected by the tenure 
reforms, we estimated the relationship between school character¬ 
istics and tenure decisions in a multivariate framework control¬ 
ling for teacher performance measures. When we estimate a 

206 I EDUCATIONAL RESEARCHER 


model that includes only the attributes of the students in the 
school, the percentage of students who are Black is the only mea¬ 
sure that is associated with the likelihood of being extended. 
This relationship may exist for a variety of reasons, including the 
differential effectiveness of teachers initially assigned to schools 
with high percentages of Black students as well a lack of mentor¬ 
ing and leadership that support the growth of teachers in such 
schools. When teacher attributes are added to the model, they 
dominate the determination of whether a teacher is extended. 
The estimate for the percentage of Black students drops substan¬ 
tially in magnitude such that a one-standard-deviation increase 
in the percentage of Black students (26.4 percentage points) is 
estimated to increase the likelihood of a teacher being extended 
by just over 1% (see Table A5 in the appendix). Thus, the likeli¬ 
hood of teachers being extended is much greater in schools with 
larger percentages of Black students, but the differential primar¬ 
ily results from these schools having more teachers judged to be 
ineffective and developing. 

Discussion 

Teacher tenure has been a hotly debated issue for decades, but 
there is surprisingly little research that documents the effects of 
various tenure policies. This article examines an unusual change 
in the tenure policy in New York City as a step toward providing 
evidence to support the design of teacher workforce policies. We 
believe this evidence has important implications for the current 
debate regarding reforms to the tenure process. 

Our analysis documents substantial changes in tenure deci¬ 
sions following the New York City reforms. Whereas almost all 




eligible teachers received tenure prior to the change, after the 
reforms, a large share of teachers instead had their probationary 
periods extended to provide more opportunity for them to dem¬ 
onstrate the skills necessary for effective teaching and for district 
decision makers to better assess teachers’ performance. Not sur¬ 
prisingly, low-performing and less qualified teachers were more 
likely to be extended. Teachers in schools with disproportionate 
shares of Black and low-performing students also were more 
likely to be extended. Our analyses provide some evidence that 
this differential reflects a uneven distribution of less effective 
teachers, which is consistent with recent research (Isenberg et al., 
2013; Sass, Hannaway, Xu, Figlio, & Feng, 2012), although we 
cannot rule out differential application of tenure rules. Finally, 
we found evidence that the new tenure policy resulted in addi¬ 
tional voluntary attrition of teachers who were extended as well 
as additional involuntary dismissal of the small share of teachers 
who were denied tenure. Among extended teachers, those with 
lower effectiveness, as measured by principals’ ratings, but higher 
qualifications (e.g., SAT scores) were more likely to leave, poten¬ 
tially further strengthening the teacher workforce. Extended 
teachers who leave their schools are less effective as measured by 
principal ratings and value-added estimates than are those likely 
to replace them. Because teachers with poor effectiveness ratings 
are more likely to be in schools with higher percentages of Black 
students, these schools are most affected by the policy change 
and most likely to see attrition of these less effective teachers as a 
result of the reforms. These schools on average were able to hire 
more effective teachers to fill these vacancies. 

New York City’s reforms to the tenure process are still in their 
early stages, and much remains to be learned. Learning to 
become an effective teacher is complicated and dependent on 
many factors, some of which are out of the control of teachers. 
Our results suggest large effects but provide only preliminary 
evidence because we have not fully ruled out the effects of other 
factors that may have been at play in the district simultaneously. 
Nor do we understand mechanisms by which some teachers suc¬ 
ceed and others choose to leave. In addition, our findings should 
be viewed as a short-run response to the NYCDOE tenure 
reform. The long-run implications are unclear but could poten¬ 
tially be less salient if extended teachers come to understand they 
will not be denied tenure, replacement teachers are not more 
effective, or the overall applicant pool of new teachers is depressed 
as a result of tenure reform. Finally, many extended teachers 
transfer to other NYCDOE schools. What are the circumstances 
of these transfers, and what is the performance of these teachers 
following their transfer? With additional data, a causal analysis 
will be more feasible, and we can address many of these ques¬ 
tions. Although the direct effects of the tenure reforms are felt by 
teachers facing tenure decisions, the labeling of teachers and 
increased likelihood of receiving an extension may induce other 
teachers in the same school, subject, and/or grade to reassess 
their positions. These processes may encourage principals to 
reassign teachers across grades and subjects or to reallocate 
responsibilities in other ways. 

Changes in human resource practices, including new hiring 
and evaluation policies, have been hallmarks of many recent 
reforms. Although the tenure process has been the subject of 
continual debate, reforms have been slower and less sustained in 


this area. In part as a result, research on tenure policies and vari¬ 
ety of possible approaches to probationary periods and screening 
is sparse. Nearly all districts grant some form of tenure based at 
least in theory on teachers’ demonstration of proficiency. Yet 
many districts do only cursory evaluation during the tenure pro¬ 
cess. As such, adopting tenure reform similar to that presented 
here may be comparatively easy relative to other much discussed 
human resource policies that require more controversial policy 
changes. 

NOTES 

Thanks to Joanna Cannon, Anne-Marie Hoxie, and Keely 
Alexander at the New York City Department of Education (NYCDOE) 
for providing the data employed in this article and for answering 
questions about the NYCDOE tenure policy. We benefited from 
comments by Arthur Mckee, Doug Harris, and three anonymous 
reviewers on earlier drafts of this article. We appreciate financial sup¬ 
port from the National Center for the Analysis of Longitudinal Data in 
Education Research (CALDER). CALDER is supported by IES Grant 
R305A060018. The views expressed in the paper are solely those of the 
authors. Any errors are attributable to the authors. 

! The research literature on teacher value added as a valid and reli¬ 
able measure of teacher effectiveness is not yet settled, as some argue 
that this measure may be biased (see, for example, Rothstein, 2009). 

2 Rockoff, Staiger, Kane, and Taylor (2012) examine how increased 
information can improve teacher performance and the composition of 
the teaching workforce. Rothstein (in press) examines how the supply 
of teachers matters for improving teacher effectiveness in the context of 
tenure decisions. 

3 As is true elsewhere, a portion of probationary teachers leave New 
York City public schools prior to a tenure decision. Some of these teach¬ 
ers are being “counseled out” and likely would not have been approved 
for tenure if they had completed the tenure review process. We have 
no way of credibly identifying the extent of this practice or potential 
tenure outcomes. However, we get a rough sense of the effect of this 
attrition on tenure approval rates by comparing the value added of teach¬ 
ers who exit prior to a tenure decision to those who remain. Using the 
distribution of value added of teachers with the same level of teaching 
experience who persist to a tenure decision, we identify the value-added 
score of the teacher at the 6th percentile (the percentile implied by a 
94% tenure approval rate). We then calculate the percentage of leav¬ 
ing teachers whose value-added score falls below that score. As might be 
expected based on prior research, we find that teachers who exit during 
their first 2 years have somewhat lower value added than their cohort 
colleagues who remain (Boyd, Grossman, Lankford, Loeb, & Wyckoff, 
2008; Goldhaber, Gross, & Player, 2011), but no more than 8% of leav¬ 
ers fall below the cutoff score, suggesting that 92% of the teachers who 
exit prior to a tenure decision would have been granted tenure prere¬ 
form. Given that 70% of teachers in our sample persist to a tenure deci¬ 
sion, the net effect on tenure approval rates is very small, resulting in an 
approval rate greater than 93%. This result is at best an approximation. 
Value added is a noisy measure, so our estimates should not be viewed 
as precise. Principals were probably unaware of teacher value added, and 
thus counseling-out decisions were made employing other measures 
unavailable to us. However, research suggests that even in the absence of 
value-added data, principals identify most of the same low-performing 
teachers as does a value-added metric (Jacob & Lefgren, 2008). 

4 These effectiveness ratings are distinct from the ratings built into 
the new statewide teacher evaluation system, which was not imple¬ 
mented until 3 years later, in 2013-2014. Although they use the same 
ratings scale, both the evidence synthesized and the relative weight 
assigned to the evidence differ between the two. 
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5 These sources of evidence were employed in 2009-2010 tenure 
decisions, but they were not aggregated in the effectiveness ratings. 

6 The Absent Teacher Reserve pool is composed of teachers who 
previously taught in New York City public schools but who currently 
do not have a permanent teaching assignment. These teachers continue 
to be paid and can be called upon to teach if vacancies arise. 

7 See Corcoran, Schwartz, and Weinstein (2009) as well as descrip¬ 
tions of accountability in New York City at http://schools.nyc.gov/ 
Accountability/tools/accountability/default.htm. 

8 We employ our own value-added estimates rather than those esti¬ 
mated by the New York City Department of Education (NYCDOE) 
primarily because NYCDOE estimates are not available for all of the 
years of our analysis and because we employ estimates that have been 
adjusted for measurement error through an empirical Bayes shrinkage 
approach. 

9 Given the new policy, it is reasonable to wonder whether teachers 
voluntarily exited at higher rates prior to a tenure decision, thus under¬ 
stating the potential effects of the policy. We do not know the ratio¬ 
nale for teacher attrition and thus cannot assess this question directly. 
However, because we have value added for teachers in tested grades 
and subjects prior to tenure decisions, both before and after the tenure 
reform, we can explore whether the reform induced a change in attri¬ 
tion with respect to value added. As shown in Table A2 in the appendix, 
of the 2 years for which we have postreform value-added data and for 
the first 2 years of a teachers probationary period, the only significant 
pre-versus postreform difference we see is for lst-year teachers in 2010. 
In that case, the value added of probationary teachers who exit postre¬ 
form is lower than that of probationary teachers leaving prereform, sug¬ 
gesting the pre- versus postreform change in the percentage of teachers 
approved for tenure would have been even larger if these teachers had 
remained to stand for tenure. 

10 Teachers who were hired include both those new to teaching and 
teachers who transferred from other schools. 

n The vast majority of teachers with tenure decisions in 2010- 
2011 and 2011-2012 began their probationary periods in 2008-2009 
or 2009-2010. We therefore are comparing the extended leavers to 
other teachers hired under similar circumstances to themselves. We are 
making the assumption that the teachers hired in 2009 and 2010 at the 
schools where an extended teacher left in 2010-2011 or 2011-2012 
have measured effectiveness similar to those teachers hired at these 
schools in 2011-2012 and 2012-2013. We have also created a replace¬ 
ment comparison group of teachers by examining teachers who were 
hired at these schools from 2006-2007 through 2009-2010. The proxy 
replacements include information on principal effectiveness ratings for 
all teachers who persist to a tenure decision and value-added data for 
all teachers who began teaching at these schools during 2009 or 2010. 

12 Employing the sample of teachers entering schools between 
2006-2007 and 2009-2010 as the proxy replacement comparison 
group, we estimate the percentage of teachers rated highly effective or 
effective is 44 percentage points higher for the proxy replacements than 
for the extended leavers. Estimated value added is 13% of a standard 
deviation higher in English language arts and 14% of a standard devia¬ 
tion higher in math, which are both significant at the .06 level. 
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Technical Appendix 

Estimation of Teacher Value Added 

We estimate teacher-by-year value added employing a multistep 
residual-based method similar to that employed by the University 
of Wisconsin’s Value-Added Research Center (VARC). VARC 
estimates value added for several school districts, including until 
quite recently New York City. 

We initially estimate Equation (1), which regresses achieve¬ 
ment (Y ics j) for student i in class c at school s taught by teacher j 
in time t as a function of prior achievement {Y ics p_f student 
attributes (X^), and class fixed effects (o t cs f). In this model, the 
class fixed effects subsumes both the teacher-by-year fixed effect 
(xf and any other class (Z c f or school-level (SJ predictors of 
student achievement. 

Y icsjt = Y Y icsjt-l + P ' X icsjt + a csjt + E icsjt > Q) 

where a . = fZ . + cp'S. + x... 

Employing these estimates, we calculate the residuals {r k f 
from this regression without accounting for a cs - t and then esti¬ 
mate Equation (2), which regresses this residual on class and 
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school characteristics as well as a class random effect to 
reflect the grouping of students into classrooms. 

r icsjt = « CSjt + = Y Z csjt + <P'Srf + Zjt + • (2) 

Employing these estimates, we calculate the residuals (q ics f) from 
this model and calculate teacher-by-year value added by averag¬ 
ing across the student-level residuals within a teacher and year. 

^jt ~ tficsjt 

The standard errors of the teacher-by-year value-added estimates 
are estimated as shown in Equation (4) using the student-level 
errors {e ics - t = q ics - t - x.) from Equation (3) and number of obser¬ 
vations for each teacher-by-year group. 

We then employ a standard empirical Bayes shrinkage method to 
account for the varying uncertainty associated with each teacher- 
by-year value-added estimate. 
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Table A1 

Descriptive Statistics for the Analytic Sample, 2009-2010 to 2012-2013 


Variable 

Observations 

M 

SD 

Tenure outcome (%) 

Approve 

19,372 

66.6 

47.2 

Extend 

19,372 

30.3 

46.0 

Deny 

19,372 

3.1 

17.2 

Teacher attributes 

Female (%) 

19,335 

75.7 


Black (%) 

17,113 

18.5 


Hispanic (%) 

17,113 

16.6 


SAT Math 

9,104 

498 

102.0 

SAT Verbal 

9,104 

501 

98.0 

Preparation path (%) 

College recommended 

19,237 

51.8 


Teaching Fellow 

19,237 

21.9 


Teach for America 

19,237 

2.9 


Individual evaluation 

19,237 

8.5 


Temporary license 

19,237 

5.1 


Student attributes (aggregated to school) 

Hispanic (%) 

15,124 

43.8 

25.1 

Black (%) 

15,124 

31.0 

26.3 

Free lunch (%) 

14,057 

63.4 

27.5 

Reduced-price lunch (%) 

14,057 

3.9 

4.1 

Mean ELA score (z score) 

11,010 

4.9 

44.7 

Mean math score (z score) 

11,022 

3.0 

49.8 

Teacher performance measures (%) 

U rated 

19,372 

2.33 


D rated 

19,372 

0.14 


Principal final effectiveness ratings 

Ineffective 

13,080 

2.3 

15.0 

Developing 

13,080 

29.2 

45.5 

Effective 

13,080 

42.6 

49.4 

Highly effective 

13,080 

15.3 

36.0 

No rating 

13,080 

10.6 

30.8 

Low attendance 

13,080 

8.0 

27.0 

VAM ELA 

1,498 

0.00 

1.1 

VAM math 

1,538 

0.08 

1.2 

NYC VAM low 

2,410 

9.3 


NYC VAM high 

2,408 

8.0 



Note. ELA = English language arts; U = unsatisfactory; D = doubtful; VAM = teacher value added; NYC = New York City. 
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Table A2 


Average Teacher Value-Added Scores for Teachers Who Remain for Tenure Decision and Those Who Leave 
Prior to the Tenure Decision by Subject, Year of Experience, and Tenure Cohort 



2008- 

-2009 


2010 


2011 

Subject 

Receive 

Tenure 

Decision 

Leave Prior 
to Tenure 
Decision 

Receive 

Tenure 

Decision 

Leave Prior 
to Tenure 
Decision 

Receive 

Tenure 

Decision 

Leave Prior 
to Tenure 
Decision 

1 st year of probationary period 

Math 

-.241 

-.316 

-.246 

-.512* 

-.223 

-.419 

ELA 

-.191 

-.228 

-.197 

-.443** 

-.175 

-.182 

2nd year of probationary period 

Math 

.045 

.001 

.091 

-.046 

-.004 

-.142 

ELA 

-.062 

-.050 

.021 

-.049 

-.003 

.028 

Note. ELA = English language arts. 

*p < .05. **p < .01 (compared 2008-2009 pooled cohort). 


Table A3 

Attributes of Teachers by Tenure Outcomes, 2010-2011 Through 2012-2013 

Tenure Decision 

Value Added 

U Rated 

D Rated 

Low 

Attendance 

SAT 

LAST Exam 

Preparation Route (%) a 


ELA 

Math 

(%) 

(%) 

(%) 

Math 

Verbal 

CR 

NYCTF 

TFA 

IE 

Approve 

.081 

.248 

5.7 

22.2 

37.1 

505 

505 

257 

59.9 

49.5 

60.2 

55.0 

Extend 

-.138 

-.129 

52.1 

66.7 

56.2 

490 

494 

254 

37.8 

47.2 

38.9 

40.7 

Deny 

-.115 

-.740 

42.2 

11.1 

6.7 

469 

490 

248 

2.4 

3.2 

0.1 

4.3 

Total 

-.009 

.070 

100.0 

100.0 

100.0 

498 

500 

255 

100.0 

100.0 

100.0 

100.0 


Note. Means of teachers approved exceed those of teachers extended at a p value of .05 or lower for all attributes. The means of teachers extended exceed those of 
teachers denied at a p value of .05 or lower for all variables except ELA value added and verbal SAT. ELA = English language arts; U = unsatisfactory; D = doubtful; CR = 
college recommended; NYCTF = New York City Teaching Fellows; TFA = Teach for America; IE = individual evaluation. 

a The tenure approval rate is lower for teachers prepared through the NYCTF and IE preparation routes than those from CR programs at p values of .01 or lower. There is no 
statistical difference between CR and TFA. 


Table A4 

Attributes of 2011 and 2012 Extended Teachers by Disposition in the Following Year 


Attrition Status 

Value Added 

U Rated 

D Rated 

Low 

Attendance 

SAT 



Preparation Route (%) 


ELA 

Math 

(%) 

(%) 

(%) 

Math 

Verbal 

LAST Exam 

CR 

NYCTF 

TFA 

IE 

Same School 

-.091- 

-.090 

4.Of 

0.2** 

10.7 

491 

495 

253** 

77.5 

70.9** 

53.3** 

78.8* 

Transfer 

-.355 

-.421 

2.7 

0.2 

11.2 

482 

486 

253 

16.3 

15.6 

9.0 

17.7 

Exit 

-.332 

-.145 

2.9 

0.0 

9.1 

530 

539 

267 

6.2 

13.6 

37.7 

3.5 


Note. For value added, U rated, D rated, low attendance, SAT and LAST exam, significance levels denote significant differences between the values of these variables for 
extended teachers who remain in same school and those who either transfer or exit. For preparation routes, significance levels denote differences between designated route 
and CR. ELA = English language arts; U = unsatisfactory; D = doubtful; CR = college recommended; NYCTF = New York City Teaching Fellows; TFA = Teach for America; 

IE = individual evaluation. 
tp< .10. *p< .05. ** p< .01. 
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Table A5 

Determinants of Whether Teacher Is Extended Relative to Being Approved, 2010-11 and 2011-12 



(D 

(2) 


Extended 

Extended 

Variable 

(=d 

(=d 

Student attributes 

Mean math score 

-0.096 (-1.41) 

-0.073t(-1.77) 

Mean English language arts score 

-0.010 (-0.14) 

0.021 (0.49) 

Black (%) 

0.211** (-4.41) 

0.048f (1.80) 

Hispanic (%) 

0.032 (-0.62) 

-0.008 (-0.27) 

Free lunch (%) 

0.012 (-0.20) 

-0.041 (-1.13) 

Reduced-price lunch (%) 

-0.066 (-0.26) 

-0.043 (-0.28) 

Teacher attributes 

Low attendance 


0.066** (3.84) 

Unsatisfactory rated 


0.101** (2.85) 

Doubtful rated 


-0.125 (-0.75) 

Principal final rating 

Ineffective 


0.867** (25.61) 

Developing 


0.906** (95.62) 

Effective 


0.100** (8.72) 

No rating 


0.334** (12.95) 

Constant 

0.340** (-6.12) 

0.081* (2.45) 

Observations 

6,351 

6,351 

f? 

0.033 

0.613 


Note. T statistics in parentheses. 
tp< .10. *p< .05. **p< .01. 
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